Device and method for robotic process automation of multiple electronic computing devices

ABSTRACT

A device and a method for robotic process automation of multiple electronic computing devices are disclosed. The device creates and stores a script that records at least an event relating to a first device and at least one action corresponding to the event. The device continuously receives a current screenshot image of a first device, and continuously analyzes the current screenshot image of the first device according to the script so as to determine whether the event has occurred. When determining that the event has occurred, the device generates at least one control signal corresponding to the at least one action according to the script, and transmits the at least one control signal to a second device, so as to perform the at least one action for the second device.

PRIORITY

This application claims priority to Taiwan Patent Application No.110107308 filed on Mar. 2, 2021, which is incorporated herein byreference in its entirety.

FIELD

The present disclosure relates to a device and a method for the roboticprocess automation. More specifically, the present disclosure relates toa device and a method for the RPA of multiple electronic computingdevices.

BACKGROUND

Robotic Process Automation (RPA) is an automated method that simulatesthe user's operating behavior on an electronic device through softwareprogramming, and then assists or replaces the user in operating theelectronic device. The RPA is quite suitable to be used in workingenvironments that often need to perform the same or similar operationsrepeatedly, such as industrial production environments that containvarious production equipment. However, conventional RPA devices can onlyautomate processes for a single device, and cannot integrate software oroperating systems in different devices. In addition, due to the concernsof information security, the equipment in the industrial productionenvironment are usually restricted from connecting to the Internet. Thisalso causes the equipment in the industrial production environment toonly be automated by its dedicated RPA device, and it is impossible toimplement multi-machine automation with a single RPA device. In view ofthis, how to design an RPA device for multiple electronic computingdevices is indeed a technical problem that needs to be solved in thetechnical field of the present disclosure.

SUMMARY

To solve at least the aforementioned problem, the present disclosureprovides a device for robotic process automation. The device maycomprise a storage, a communication interface and a processor. Theprocessor may be electrically connected with the storage and thecommunication interface. The storage may be configured to store ascript, and the script may record at least an event corresponding to afirst device, and at least one action corresponding to the event. Thecommunication interface may be coupled with the first device and asecond device, and may be configured to continuously receive a currentscreenshot image of the first device. The processor may be configured tocreate the script, and continuously analyze the current screenshot imageof the first device according to the script so as to determine whetherthe event has occurred. The processor may be further configured togenerate at least one control signal corresponding to the at least oneaction according to the script when determining that the event hasoccurred. The communication interface may be further configured totransmit the at least one control signal to the second device so as toperform the at least one action for the second device.

To solve at least the aforementioned problem, the present disclosurefurther provides a method for robotic process automation. The method maybe executed by an electronic computing device. The electronic computingdevice stores a script and at least one action, the script recording atleast an event corresponding to a first device, the at least one actioncorresponding to the event. The method in certain embodiments maycomprise:

continuously receiving a current screenshot image of the first device;

creating the script;

continuously analyzing the current screenshot image of the first deviceaccording to the script so as to determine whether the event hasoccurred; and

generating at least one control signal corresponding to the at least oneaction according to the script, and transmitting the at least onecontrol signal to a second device, so as to perform the at least oneaction for the second device.

Based on the above, the device and method for RPA provided by thepresent disclosure perform non-invasive event determination by analyzingscreenshot images, and integrate simultaneous operation process betweenthe first device and the second device through scripts such that when anevent involving the first device occurs, at least one actioncorresponding to the event is executed on the second device accordingly,thereby achieving the cross-device RPA. Therefore, the device and methodfor RPA provided by the present disclosure indeed solve theabove-mentioned problems in the technical field of the presentdisclosure.

The aforesaid content is not intended to limit the present invention,but merely provides preliminary profile of the present invention topeople having ordinary skill in the art. People having ordinary skill inthe art can understand the details of the present invention according tothe attached drawings and the embodiments recited in the followingdetailed description.

BRIEF DESCRIPTION OF THE DRAWINGS

The appended drawings may assist the understanding of the variousembodiments of the present invention, wherein:

FIG. 1 depicts a device for RPA according to one or more embodiments ofthe present disclosure;

FIG. 2A and FIG. 2B depict the graphics user interface (GUI) created bythe device for RPA according to one or more embodiments of the presentinvention; and

FIG. 3 depicts a method for RPA according to one or more embodiments ofthe present invention.

DETAILED DESCRIPTION

Hereinafter, the present invention will be described through a number ofexample embodiments, but these example embodiments are not intended tolimit the present invention to only be implemented according to theoperation, environment, application, structure, process, or stepsrecited therein. For ease of description, contents not directly relatedto the embodiment of the present invention or contents that can beunderstood without specific descriptions will be omitted in this textand the drawings. In the drawings, the size of each element and theratio between each element are only examples, and are not for limitingthe present invention. In the following content, the same (or similar)reference numbers may correspond to the same (or similar) components,except for those that are specially described. On the premise that itcan be implemented, the quantity of each element described below may beone or more, unless otherwise specified.

FIG. 1 depicts a device for RPA according to one or more embodiments ofthe present disclosure. The contents shown in FIG. 1 are merely forexplaining the embodiments of the present invention instead of limitingthe present invention.

Referring to FIG. 1 , a device 1 for RPA (hereinafter also referred toas “RPA device 1”) may basically comprise a storage 11, a communicationinterface 12 and a processor 13, and the processor 13 may beelectrically connected with the storage 11 and the communicationinterface 12. Note that the electrical connection between the aboveelements may be direct (i.e., connected to each other through no otherfunctional components) or indirect (i.e., connected to each otherthrough other functional components). The RPA device 1 may be variouselectronic devices with computing capabilities, such as but not limitedto: desktop computers, portable computers, smartphones, portableelectronic accessories (glasses, watches, etc.) The RPA device 1 mayachieve the RPA by executing a process defined in a script. The specificdetails will be described later.

The storage 11 may be used to store data generated by the RPA device 1,data transmitted to the RPA device 1 from an external device, or datainput to the RPA device 1 by a user. The storage 11 may comprise variousstorage units provided in a general computing device/computer, so as toimplement various corresponding functions described below. For example,the storage 11 may comprise a first-level memory (also called mainmemory or internal memory), and the processor 13 may directly read theinstruction sets stored in the first-level memory and execute it whenneeded said instruction sets. The storage 11 may also comprise asecond-level memory (also called an external memory or an auxiliarymemory), which can transmit the stored data to the first-level memorythrough a data buffer. The secondary memory may be, for example, but notlimited to: hard disk, optical disk, etc. The storage 11 may alsocomprise a third-level memory, i.e., a storage device that can bedirectly inserted into or removed from the computer, such as a portablehard drive or a cloud hard drive. The memory may be used to store ascript 111, and the script 111 may record at least one event and atleast one action corresponding to the event, the details of which willbe further described later.

The communication interface 12 may be used to transmit and receive datawith external devices and/or users. For example, the communicationinterface 12 may be coupled with a first device 121 and a second device122, and may receive the current screenshot image P1 from the firstdevice 121 and the current screenshot image P2 from the second device122. In addition, the communication interface 12 may also transmit atleast one control signal (e.g., the control signal S1) to the seconddevice 122 to operate the second device 122. The first device 121 andthe second device 122 may be target devices for RPA, which specificallymay be, for example, but not limited to, the control computer for aproduction device in an industrial production environment (for example,but not limited to: a laser drilling machine for printed circuit boards(PCB), an automatic optical inspection (AOI) machine, a wafer prober,etc.) The current screenshot image P1 and the current screenshot imageP2 may be the contents being displayed by the operating systems of thefirst device 121 and the second device 122, respectively. Said contentsmay vary over time, that is, the current screenshot image P1 or thecurrent screenshot image P2 at different time points may be differentimages.

In some embodiments, the communication interface 12 may also receive animage-capturing command C1, an event-defining command C2, anaction-assigning command C3, or the like from a user 123, the details ofwhich will be described later. In some embodiments, the communicationinterface 12 may also be coupled with at least one input/output (I/O)signal integrator (e.g., an I/O signal integrator 124) to receive and/ortransmit the aforementioned data or signals between the communicationinterface 12 and the first device 121, and the aforementioned data orsignals between the communication interface 12 and the second device122, through the at least one I/O signal integrator. The at least oneI/O signal integrator may receive image data from the first device 121and the second device 122 and at least one control signal from thecommunication interface 12 in a wired or wireless manner, and mayprovide integration and switching functions. The at least one I/O signalintegrator may be, for example, but not limited to, akeyboard-video-mouse (KVM) switch. It should be clarified that the terms“first” and “second” used for the “devices” in the present disclosureare only used for labeling, and are not used for limiting theirhierarchy or order.

In some embodiments, the communication interface 12 may be various I/Ointerfaces in a computing device/computer, such as but not limited to: aUniversal Serial Bus (USB) interface, a Video Graphics Array (VGA)interface, a High Definition Multimedia Interface (HDMI), etc. In thiscase, the RPA device 1 may obtain the screenshot image of an externaldevice through the communication interface 12 (e.g., the currentscreenshot image P1 of the first device 121 and the current screenshotimage P2 of the second device 122, or the like). The RPA device 1 mayalso be connected with a mouse, a touchpad, a keyboard, a touch screenand other input devices through the communication interface 12, and thenreceive various commands from the user 123 (e.g., the image-capturingcommand C1, the event-defining command C2, the action-assigning commandC3, or the like). In some embodiments, the communication interface 12may also be electrically connected with a display, so as to presentvarious image outputs of the RPA device 1 through the display.

In some embodiments, the communication interface 12 may be atransceiver, which may be used for wired or wireless communication withexternal devices. Regarding the wireless communication, thecommunication interface 12 may comprise, for example, but not limitedto: antennas, amplifiers, modulators, demodulators, detectors,analog-to-digital converters, digital-to-analog converters and othercommunication elements. As for the wired communication, thecommunication interface 12 may be, for example, but not limited to: agigabit Ethernet transceiver, a gigabit interface converter (GBIC), asmall form-factor pluggable (SFP) transceiver, a ten-gigabit smallform-factor pluggable (XFP) transceiver, etc. In this case, thecommunication interface 12 may form an internal/local network (not shownin the drawings) with an I/0 signal integrator electrically connectedwith the first device 121 and another I/O signal integrator electricallyconnected with the second device 122 to obtain the current screenshotimage P1 of the first device 121 and the current screenshot image P2 ofthe second device 122 through the I/O signal integrators, and maytransmit a control signal S1 to the second device 122. In addition, thecommunication interface 12 may also receive the aforementionedimage-capturing command C1, event-defining command C2, action-assigningcommand C3 or the like from the user 13 through a wired or wirelessmanner.

The processor 13 may be a microprocessor or a microcontroller or thelike with a signal processing function. A microprocessor ormicrocontroller is a special programmable integrated circuit, which hasthe capabilities of calculation, storage, output/input, etc., and canaccept and process various coding instructions, so as to perform variouslogic operations and arithmetic operations, and output the correspondingcalculation result. The processor 13 can be programmed to interpretvarious instructions and perform various calculation tasks or programs.The processor 13 may be used to create the script 111.

Next, how the RPA device 1 according to the embodiment of the presentinvention achieves multi-device robotic process automation will bedescribed in detail through FIG. 1 , FIG. 2A, and FIG. 2B. FIG. 2A andFIG. 2B depict the graphics user interface (GUI) created by the devicefor RPA according to one or more embodiments of the present invention.The contents shown in FIG. 2A and FIG. 2B are merely for explaining theembodiments of the present invention instead of limiting the presentinvention.

Referring to FIG. 1 , FIG. 2A and FIG. 2B together, first, thecommunication interface 12 may continuously receive the currentscreenshot image P1 of the first device 121 and the current screenshotimage P2 of the second device 122. The processor 13 may provide a GUI 2so that the user 123 may operate in the GUI 2 through the communicationinterface 12. Specifically, as shown in FIG. 2A, the processor 13 maypresent the current screenshot image P1 of the first device 121 and thecurrent screenshot image P2 of the second device 122 simultaneously on afirst page of the GUI 2, and may present a script-editing section 21 andan action-selecting section 22 on a second page of the GUI 2, as shownin FIG. 2B. In some embodiments, the RPA device 1 may also present theGUI 2 through the communication interface 12 and a display so as todisplay the current screenshot image P1 and the current screenshot imageP2 to the user.

Through the first page and the second page, the user 123 may provide animage-capturing command C1, an event-defining command C2, and anaction-assigning command C3 to the RPA device 1, and the processor 13may define events and the corresponding actions in a script 111according to those commands. Specifically, first, the processor 13 maycapture a target image (not shown in the drawings) from the currentscreenshot image P1 of the first device 121 displayed on the first pageaccording to the image-capturing command C1 of the user 123 (forexample, but not limited to: selecting a range by moving the cursor).Then, the processor 13 may define an event 211 in, for example, but notlimited to, the first page as “the target image appears in the currentscreenshot image P1 of the first device 121” according to theevent-defining command C2 of the user 123 (for example, but not limitedto: select the “Define Event” option in a menu that appears on thescreen when moving and clicking the cursor at a specific position), andthen, the GUI element Ell representing the event 211 may be displayed inthe script-editing section 21 in the second page. Subsequently, theprocessor 13 may designate at least one action corresponding to theevent 211 as the action 223 according to the action-assigning command C3of the user 123, thereby creating the script 111. The action-assigningcommand C3 may be, for example, but not limited to: selecting at leastone of a plurality of GUI elements E21, E22, E23, E24 that respectivelyrepresent a plurality of actions 221, 222, 223, 224 through the cursoron the second page, and then selecting the “Assign Action” option in amenu that appears on the screen to associate the selected GUI elementwith the GUI element Ell; or moving at least one of the GUI elementsE21, E22, E23, E24 in the action-selection section 22 to thescript-editing section 21 in the second page by means of drag and drop,so as to associate the selected element with the GUI element E11. Insome embodiments, the processor 13 may also edit the details of theactions 221, 222, 223, and 224 through the first page and the secondpage.

The aforementioned target image may be a “partial” image that containsspecific icons, numbers, characters and/or symbols. In addition, theaforementioned actions 221, 222, 223, and 224 may be actions formed byat least one operation performed on the mouse and/or keyboard of thesecond device 122, and the at least one operation may be, for example,but not limited to: right-click on the mouse, double-clicks on the leftmouse button, moving the mouse cursor to a specific location, pressingkeyboard keys, entering characters in the input field, switching betweenapplications through keyboard shortcuts, selecting specific objects withthe mouse cursor, and sliding the mouse cursor to perform drag and drop,and so on. In some embodiments, when the abovementioned action comprisesperforming an action for a specific position and/or a specific object(e.g., selecting a specific object with the mouse cursor, moving themouse cursor to a specific position, inputting characters in the inputfield, or the like), the processor 13 may further analyze the currentscreenshot image P2 of the second device 122 to find the specificposition and/or specific object in the current screenshot image P2, andperform said action for it.

For example, the target image may be a partial screenshot of atemperature field displayed by the first device 121, and may include astring indicating that the temperature of the device is higher than aspecific temperature (e.g., text that writes “Current Temperature: 200degrees Celsius”). Therefore, once the processor 13 determined that thetarget image has appeared in the current screenshot image P1 (i.e., theevent 211 has occurred), which indicates that the temperature of thefirst device 121 has been higher than the specific temperature,therefore a corresponding cooling action should be executed for thefirst device 121. Accordingly, the action 223 corresponding to the event211 may be detecting a “temperature control” option of the first device121 in the current screenshot image P2 of the second device 122 (e.g.,the second device 122 may be a temperature control device), and movingthe cursor to said option, and clicking on said option.

For another example, the target image may include a warning iconindicating that the voltage of the first device 121 is too high.Therefore, when the processor 13 determines that the target image hasappeared in the current screenshot image P1 of the first device 121(i.e., the event 211 has occurred), it can perform a correspondingpower-off action on the first device 121. Accordingly, the action 223corresponding to the event 211 may be “inputting a correspondingpower-off command in a command-input field shown in the currentscreenshot image P2 of the second device 122 (e.g., the second devicemay be a power-off device)”.

For another example, the target image may include a text that writes“product abnormality detected”. Therefore, when the processor 13determined that the target image has appeared in the current screenshotimage P1 of the first device 121 that belongs to the product examinationdevice (i.e., the event 211 has occurred), it may adjust themanufacturing parameters of its product. Accordingly, the action 223corresponding to the event 211 may be “moving the cursor to aparameter-input box shown in the current screenshot image P2, clickingon the parameter-input box, and inputting a specific parameter therein”.More specifically, in some embodiments, the processor 13 may alsoanalyze the current screenshot image P2 of the second device 122 thatbelongs to a production device, so as to find the parameter-input box inthe current screenshot image P2. Then, the processor 13 may transmit thecontrol signal Si to the second device 122 through the communicationinterface 12 to perform the actions of “moving the cursor, clicking onthe parameter-input box, and inputting a specific parameter therein” toadjust the manufacturing parameters of its product.

In some embodiments, the processor 13 may analyze the current screenshotimage P1 and the current screenshot image P2 through a deep learningmodel based on the convolutional neural network architecture, therebydetecting whether the above-mentioned target image appears in thecurrent screenshot image P1, and detecting specific objects (e.g., theaforementioned parameter-input box, command-input field) in the currentscreenshot image P2. The deep learning model may be trained by theprocessor 13 or may be pre-trained by an external device and then inputinto the RPA device 1. It should be understood that those with ordinaryskills in the art can adopt corresponding training data according to thetype of the target image. In some embodiments, the processor 13 may alsorecognize the characters in the current screenshot image P1 and thecurrent screenshot image P2 through techniques such as optical characterrecognition (OCR).

It should be understood that the content of the GUI 2 and the script 111described above is only an example and not a limitation. In some otherembodiments, the user 123 may define various events and assign aplurality of corresponding actions by continuously providing theaforementioned image-capturing command C1, the event-defining command C2and the action-assigning command C3, and the communication interface 12and the processor 13 may continuously perform the aforementionedoperations in the first page and the second page according to saidcommands, thereby creating a script 111 with relatively more complexcontent.

After the script 111 is created, the processor 13 may execute the script111 to determine whether each event recorded therein has occurred andexecute corresponding actions accordingly, so as to achieve a processautomation. Specifically, the processor 13 continuously analyzes thecurrent screenshot image P1 of the first device 121 after executing thescript 111 to determine whether the event 211 (i.e., the target imageappears in the current screenshot image P1 of the first device 121) hasoccurred. When the processor 13 determined that the event 211 hasoccurred, the processor 13 may generate a control signal S1corresponding to the action 223 according to the script 111, and thecommunication interface 12 may transmit the control signal S1 to thesecond device 122 so as to perform the action 223 for the second device122, thereby achieving a cross-device RPA. In some embodiments, thecontrol signal S1 may be an input signal when the mouse and/or keyboardof the second device 122 perform the action 223.

In some embodiments, the processor 13 may further define another eventin the script 111 and assign another action corresponding to the otherevent. The other event may be that another target image appears in thecurrent screenshot image P1 of the first device 121. Accordingly, theprocessor 13 may continuously analyze the current screenshot image P1 todetermine whether the other event has occurred, and if so, it maygenerate another control signal corresponding to the other actionaccording to the script 111, and transmit the other control signal tothe first device 121 through the communication interface 12 so as toperform the other action on the first device 121. In some embodiments,similarly, the other event may be that another target image appears inthe current screenshot image P2 of the second device 122. Accordingly,the processor 13 may continuously analyze the current screenshot imageP2 to determine whether the other event has occurred, and if so, it maygenerate another control signal corresponding to the other actionaccording to the script 111, and transmit the other control signal tothe second device 122 through the communication interface 12 so as toperform the other action on the second device 122. In this way, the RPAdevice 1 is able to perform an RPA for a single device.

For example, when the processor 13 determines that a pattern of red dothas appeared on an icon of an application in the current screenshotimage P1 of the first device 121 (e.g., a computer) (i.e., another eventhas occurred), which indicates that there is a new notification aboutthe application in the system, so the processor 13 may generate acontrol signal corresponding to “clicking on the icon of the applicationwith the mouse cursor” according to the script 111, and transmit thecontrol signal to the first device 121 through the communicationinterface 12, such that the application icon with the pattern of red dotin the first device 121 be clicked, thereby displaying the newnotification of the application.

To sum up, the RPA device 1 of the present disclosure creates a script111 for the simultaneous operation of a plurality of devices. Therefore,the RPA device 1 is able to determine that the event 211 correspondingto the first device 121 has occurred in a non-invasive way ofscreenshot-image analysis, and operate the second device 122 accordinglyin response to the event 211, wherein the operation for the seconddevice 122 is also based on non-invasive screenshot image analysis. Inaddition, the RPA device 1 of the present disclosure is also able toperform the RPA for a single device in some embodiments. In view ofthis, the RPA device 1 of the present disclosure has indeed achieved theRPA among multiple devices, thereby solving the aforementioned problemsin the prior art.

FIG. 3 depicts a method for RPA according to one or more embodiments ofthe present invention. The contents shown in FIG. 3 are merely forexplaining the embodiments of the present invention instead of limitingthe present invention.

Referring to FIG. 3 , a method 3 for robotic process automation may beexecuted by an electronic computing device. The electronic computingdevice may store a script and at least one action, and the script mayrecord at least an event corresponding to a first device, the at leastone action corresponding to the event. The method 3 for robotic processautomation may comprise steps as follows:

continuously receiving a current screenshot image of the first device(marked as 301);

creating the script (marked as 302);

continuously analyzing the current screenshot image of the first deviceaccording to the script so as to determine whether the event hasoccurred (marked as 303); and

generating at least one control signal corresponding to the at least oneaction according to the script, and transmitting the at least onecontrol signal to a second device, so as to perform the at least oneaction for the second device (marked as 304).

In some embodiments, the method 3 for robotic process automation mayfurther comprising steps as follows:

receiving a current screenshot image of the second device continuously;

creating a graphical user interface; and

presenting the current screenshot image of the first device and thecurrent screenshot image of the second device in the graphical userinterface simultaneously

In some embodiments, regarding the method 3 for robotic processautomation, the electronic computing device receives the currentscreenshot image of the first device from the first device and transmitsthe control signal to the second device through at least oneinput/output signal integrator.

In some embodiments, regarding the method 3 for robotic processautomation, the at least one action corresponding to at least oneoperation of a mouse and/or a keyboard.

In some embodiments, the method 3 for robotic process automation mayfurther comprising steps as follows:

capturing, according to an image-capturing command of a user, a targetimage from the current screenshot image of the first device presented inthe graphical user interface;

defining, according to an event-defining command of the user, the eventin the graphical user interface as that the target image appears in thecurrent screenshot image of the first device; and

assigning, according to an action-assigning command of the user, atleast one action to the event, thereby creating the script.

In some embodiments, the method 3 for robotic process automation mayfurther comprising steps as follows:

capturing, according to an image-capturing command of a user, a targetimage from the current screenshot image of the first device presented inthe graphical user interface;

defining, according to an event-defining command of the user, the eventin the graphical user interface as that the target image appears in thecurrent screenshot image of the first device;

assigning, according to an action-assigning command of the user, atleast one action to the event, thereby creating the script; and

receiving the image-capturing command, the event-defining command, andthe assigning-action command from the user.

Each embodiment of the method 3 for robotic process automationessentially corresponds to a certain embodiment of the RPA device 1.Therefore, even though not all of the embodiments of the method 3 forrobotic process automation are not described in detail above, those withordinary skills in the art can still directly understand the unspecifiedembodiments of the method 3 for robotic process automation according tothe description of the RPA device 1 above.

The above-mentioned embodiments are only examples for describing thepresent invention, but not for limiting the present invention. Any otherembodiments resulting from modification, change, adjustment, andintegration of the above-mentioned embodiments, as long as beingstraightforward and derivable to those with ordinary skills in the art,are covered by the scope of the present invention. The scope of thepresent invention is subject to the claims.

What is claimed is:
 1. A device for robotic process automation,comprising: a storage, being configured to store a script, wherein thescript records at least an event corresponding to a first device and atleast one action corresponding to the event; a communication interface,being coupled with the first device and a second device, and beingconfigured to continuously receive a first current screenshot image ofthe first device from the first device and continuously receive a secondcurrent screenshot image of the second device from the second device,wherein the first current screenshot image is content being displayed bya first operating system of the first device and the second currentscreenshot image is content being displayed by a second operating systemof the second device; and a processor, being electrically connected withthe storage and the communication interface, and being configured to:create the script; continuously analyze the first current screenshotimage of the first device according to the script so as to determinewhether the event has occurred; and generate at least one control signalcorresponding to the at least one action according to the script whendetermining that the event has occurred; wherein the communicationinterface is further configured to transmit the at least one controlsignal to the second device so as to perform the at least one action onthe second current screenshot image displayed on [[for]] the seconddevice.
 2. The device of claim 1, wherein the communication interface isfurther coupled to at least one input/output signal integrator, and thecommunication interface receives the first current screenshot image ofthe first device from the first device and transmits the at least onecontrol signal to the second device through the at least oneinput/output signal integrator.
 3. The device of claim 1, wherein the atleast one action corresponds to at least one operation of a mouse and/ora keyboard.
 4. The device of claim 1, wherein the processor is furtherconfigured to create a graphical user interface and present the firstcurrent screenshot image of the first device and the second currentscreenshot image of the second device in the graphical user interfacesimultaneously.
 5. The device of claim 4, wherein the processor isfurther configured to: capture, according to an image-capturing commandof a user, a target image from the first current screenshot image of thefirst device presented in the graphical user interface; define,according to an event-defining command of the user, the event in thegraphical user interface as that the target image appears in the firstcurrent screenshot image of the first device; and assign, according toan action-assigning command of the user, at least one action to theevent, thereby creating the script.
 6. The device of claim 5, whereinthe communication interface is further configured to receive theimage-capturing command, the event-defining command, and theaction-assigning command from the user.
 7. A method for robotic processautomation, being executed by an electronic computing device, theelectronic computing device storing a script and at least one action,the script recording at least an event corresponding to a first device,the at least one action corresponding to the event, the methodcomprising: continuously receiving a first current screenshot image ofthe first device from the first device, wherein the first currentscreenshot image of the first device is content being displayed by afirst operating system of the first device; continuously receiving asecond current screenshot image of the second device from the seconddevice, wherein the second current screenshot image is content beingdisplayed by a second operating system of the second device; creatingthe script; continuously analyzing the first current screenshot image ofthe first device according to the script so as to determine whether theevent has occurred; and generating at least one control signalcorresponding to the at least one action according to the script, andtransmitting the at least one control signal to a second device, so asto perform the at least one action on the second current screenshotimage displayed on the second device.
 8. The method of claim 7, whereinthe electronic computing device receives the first current screenshotimage of the first device from the first device and transmits the atleast one control signal to the second device through at least oneinput/output signal integrator.
 9. The method of claim 7, wherein the atleast one action corresponding to at least one operation of a mouseand/or a keyboard.
 10. The method of claim 7, further comprising:creating a graphical user interface; and presenting the first currentscreenshot image of the first device and the second current screenshotimage of the second device in the graphical user interfacesimultaneously.
 11. The method of claim 10, further comprising:capturing, according to an image-capturing command of a user, a targetimage from the first current screenshot image of the first devicepresented in the graphical user interface; defining, according to anevent-defining command of the user, the event in the graphical userinterface as that the target image appears in the first currentscreenshot image of the first device; and assigning, according to anaction-assigning command of the user, at least one action to the event,thereby creating the script.
 12. The method of claim 11, furthercomprising: receiving the image-capturing command, the event-definingcommand, and the action-assigning command from the user.